User Perceptions of Avatar-Based Patient Monitoring for Intensive Care Units: An International Exploratory Sequential Mixed-Methods Study.

Visual Patient Avatar ICU is an innovative approach to patient monitoring, enhancing the user's situation awareness in intensive care settings. It dynamically displays the patient's current vital signs using changes in color, shape, and animation. The technology can also indicate patient-inserted devices, such as arterial lines, central lines, and urinary catheters, along with their insertion locations. We conducted an international, multi-center study using a sequential qualitative-quantitative design to evaluate users' perception of Visual Patient Avatar ICU among physicians and nurses. Twenty-five nurses and twenty-five physicians from the ICU participated in the structured interviews. Forty of them completed the online survey. Overall, ICU professionals expressed a positive outlook on Visual Patient Avatar ICU. They described Visual Patient Avatar ICU as a simple and intuitive tool that improved information retention and facilitated problem identification. However, a subset of participants expressed concerns about potential information overload and a sense of incompleteness due to missing exact numerical values. These findings provide valuable insights into user perceptions of Visual Patient Avatar ICU and encourage further technology development before clinical implementation.

Coagulation Management of Critically Bleeding Patients With Viscoelastic Testing Presented as a 3D-Animated Blood Clot (The Visual Clot): Randomized Controlled High-Fidelity Simulation Study.

BACKGROUND: Guidelines recommend using viscoelastic coagulation tests to guide coagulation management, but interpreting the results remains challenging. Visual Clot, a 3D animated blood clot, facilitates interpretation through a user-centered and situation awareness-oriented design. OBJECTIVE: This study aims to compare the effects of Visual Clot versus conventional viscoelastic test results (rotational thrombelastometry [ROTEM] temograms) on the coagulation management performance of anesthesia teams in critical bleeding situations. METHODS: We conducted a prospective, randomized, high-fidelity simulation study in which anesthesia teams (consisting of a senior anesthesiologist, a resident anesthesiologist, and an anesthesia nurse) managed perioperative bleeding scenarios. Teams had either Visual Clot or ROTEM temograms available to perform targeted coagulation management. We analyzed the 15-minute simulations with post hoc video analysis. The primary outcome was correct targeted coagulation therapy. Secondary outcomes were time to targeted coagulation therapy, confidence, and workload. In addition, we have conducted a qualitative survey on user acceptance of Visual Clot. We used Poisson regression, Cox regression, and mixed logistic regression models, adjusted for various potential confounders, to analyze the data. RESULTS: We analyzed 59 simulations. Teams using Visual Clot were more likely to deliver the overall targeted coagulation therapy correctly (rate ratio 1.56, 95% CI 1.00-2.47; P=.05) and administer the first targeted coagulation product faster (hazard ratio 2.58, 95% CI 1.37-4.85; P=.003). In addition, participants showed higher decision confidence with Visual Clot (odds ratio 3.60, 95% CI 1.49-8.71; P=.005). We found no difference in workload (coefficient -0.03, 95% CI -3.08 to 2.88; P=.99). CONCLUSIONS: Using Visual Clot led to a more accurate and faster-targeted coagulation therapy than using ROTEM temograms. We suggest that relevant viscoelastic test manufacturers consider augmenting their complex result presentation with intuitive, easy-to-understand visualization to ease users' burden from unnecessary cognitive load and enhance patient care.

Avatar-based patient monitoring improves information transfer, diagnostic confidence and reduces perceived workload in intensive care units: computer-based, multicentre comparison study.

Patient monitoring is the foundation of intensive care medicine. High workload and information overload can impair situation awareness of staff, thus leading to loss of important information about patients' conditions. To facilitate mental processing of patient monitoring data, we developed the Visual-Patient-avatar Intensive Care Unit (ICU), a virtual patient model animated from vital signs and patient installation data. It incorporates user-centred design principles to foster situation awareness. This study investigated the avatar's effects on information transfer measured by performance, diagnostic confidence and perceived workload. This computer-based study compared Visual-Patient-avatar ICU and conventional monitor modality for the first time. We recruited 25 nurses and 25 physicians from five centres. The participants completed an equal number of scenarios in both modalities. Information transfer, as the primary outcome, was defined as correctly assessing vital signs and installations. Secondary outcomes included diagnostic confidence and perceived workload. For analysis, we used mixed models and matched odds ratios. Comparing 250 within-subject cases revealed that Visual-Patient-avatar ICU led to a higher rate of correctly assessed vital signs and installations [rate ratio (RR) 1.25; 95% CI 1.19-1.31; P < 0.001], strengthened diagnostic confidence [odds ratio (OR) 3.32; 95% CI 2.15-5.11, P < 0.001] and lowered perceived workload (coefficient - 7.62; 95% CI - 9.17 to - 6.07; P < 0.001) than conventional modality. Using Visual-Patient-avatar ICU, participants retrieved more information with higher diagnostic confidence and lower perceived workload compared to the current industry standard monitor.

Faster Time to Treatment Decision of Viscoelastic Coagulation Test Results through Improved Perception with the Animated Visual Clot: A Multicenter Comparative Eye-Tracking Study.

As the interpretation of viscoelastic coagulation test results remains challenging, we created Visual Clot, an animated blood clot aiming to facilitate raw rotational thromboelastometry (ROTEM) parameters. This study investigated anesthesia personnel's cognitive processing in managing simulated bleeding scenarios using eye-tracking technology. This multicenter, international, computer-based study across five large, central European hospitals included 35 participants with minimal to no prior experience interpreting viscoelastic test results. Using eye-tracking technology and an iPad tagged with quick response codes, we defined the time to treatment decision and the time on screen surface in seconds of correctly solved scenarios as our outcomes. The median time to treatment decision was 52 s for Visual Clot and 205 s for ROTEM (p < 0.0001). The probability of solving the scenario correctly was more than 8 times higher when using Visual Clot than when using ROTEM (Hazard ratio [HR] 8.54, 95% CI from 6.5 to 11.21; p < 0.0001). Out of 194 correctly answered scenarios of participants with the eye-tracker, 154 (79.4%) were solved with Visual Clot and 40 (20.6%) with ROTEM. Participants spent on average 30 s less looking at the screen surface with Visual Clot compared to ROTEM (Coefficient −30.74 s, 95% CI from −39.27 to −22.27; p < 0.0001). For a comparison of the two modalities in terms of information transfer, we calculated the percentage of time on the screen surface of the overall time to treatment decision, which with Visual Clot was 14 percentage points shorter than with ROTEM (Coefficient −14.55, 95% CI from −20.05 to −9.12; p < 0.0001). Visual Clot seems to improve perception and detection of coagulopathies and leads to earlier initiation of the appropriate treatment. In a high-pressure working environment such as the operating and the resuscitation room, correct and timely decisions regarding bleeding management may have a relevant impact on patients' outcomes.

User Perceptions of Different Vital Signs Monitor Modalities During High-Fidelity Simulation: Semiquantitative Analysis.

BACKGROUND: Patient safety during anesthesia is crucially dependent on the monitoring of vital signs. However, the values obtained must also be perceived and correctly classified by the attending care providers. To facilitate these processes, we developed Visual-Patient-avatar, an animated virtual model of the monitored patient, which innovatively presents numerical and waveform data following user-centered design principles. After a high-fidelity simulation study, we analyzed the participants' perceptions of 3 different monitor modalities, including this newly introduced technique. OBJECTIVE: The aim of this study was to collect and evaluate participants' opinions and experiences regarding 3 different monitor modalities, which are Visual-Patient-avatar, Split Screen (avatar and Conventional monitor alongside each other), and Conventional monitor after using them during simulated critical anesthetic events. METHODS: This study was a researcher-initiated, single-center, semiquantitative study. We asked 92 care providers right after finishing 3 simulated emergency scenarios about their positive and negative opinions concerning the different monitor modalities. We processed the field notes obtained and derived the main categories and corresponding subthemes following qualitative research methods. RESULTS: We gained a total of 307 statements. Through a context-based analysis, we identified the 3 main categories of "Visual-Patient-avatar," "Split Screen," and "Conventional monitor" and divided them into 11 positive and negative subthemes. We achieved substantial interrater reliability in assigning the statements to 1 of the topics. Most of the statements concerned the design and usability features of the avatar or the Split Screen mode. CONCLUSIONS: This study semiquantitatively reviewed the clinical applicability of the Visual-Patient-avatar technique in a high-fidelity simulation study and revealed the strengths and limitations of the avatar only and Split Screen modality. In addition to valuable suggestions for improving the design, the requirement for training prior to clinical implementation was emphasized. The responses to the Split Screen suggest that this symbiotic modality generates better situation awareness in combination with numerical data and accurate curves. As a subsequent development step, a real-life introduction study is planned, where we will test the avatar in Split Screen mode under actual clinical conditions.

Effects of an Animated Blood Clot Technology (Visual Clot) on the Decision-Making of Users Inexperienced in Viscoelastic Testing: Multicenter Trial.

BACKGROUND: Viscoelastic test-guided coagulation management has become increasingly important in assessing hemostasis. We developed Visual Clot, an animated, 3D blood clot that illustrates raw rotational thromboelastometry (ROTEM) parameters in a user-centered and situation awareness-oriented method. OBJECTIVE: This study aimed to evaluate the applicability of Visual Clot by examining its effects on users that are novices in viscoelastic-guided resuscitation. METHODS: We conducted an investigator-initiated, international, multicenter study between September 16, 2020, and October 6, 2020, in 5 tertiary care hospitals in central Europe. We randomly recruited medical students and inexperienced resident physicians without significant prior exposure to viscoelastic testing. The 7 participants per center managed 9 different ROTEM outputs twice, once as standard ROTEM tracings and once as the corresponding Visual Clot. We randomly presented the 18 viscoelastic cases and asked the participants for their therapeutic decisions. We assessed the performance, diagnostic confidence, and perceived workload in managing the tasks using mixed statistical models and adjusted for possible confounding factors. RESULTS: Analyzing a total of 630 results, we found that the participants solved more cases correctly (odds ratio [OR] 33.66, 95% CI 21.13-53.64; P<.001), exhibited more diagnostic confidence (OR 206.2, 95% CI 93.5-454.75; P<.001), and perceived less workload (coefficient -41.63; 95% CI -43.91 to -39.36; P<.001) using Visual Clot compared to using standard ROTEM tracings. CONCLUSIONS: This study emphasizes the practical benefit of presenting viscoelastic test results in a user-centered way. Visual Clot may allow inexperienced users to be involved in the decision-making process to treat bleeding-associated coagulopathy. The increased diagnostic confidence, diagnostic certainty, reduced workload, and positive user feedback associated with this visualization may promote the further adoption of viscoelastic methods in diverse health care settings.

Physicians' Perceptions of a Situation Awareness-Oriented Visualization Technology for Viscoelastic Blood Coagulation Management (Visual Clot): Mixed Methods Study.

BACKGROUND: Viscoelastic tests enable a time-efficient analysis of coagulation properties. An important limitation of viscoelastic tests is the complicated presentation of their results in the form of abstract graphs with a multitude of numbers. We developed Visual Clot to simplify the interpretation of presented clotting information. This visualization technology applies user-centered design principles to create an animated model of a blood clot during the hemostatic cascade. In a previous simulation study, we found Visual Clot to double diagnostic accuracy, reduce time to decision making and perceived workload, and improve care providers' confidence. OBJECTIVE: This study aimed to investigate the opinions of physicians on Visual Clot technology. It further aimed to assess its strengths, limitations, and clinical applicability as a support tool for coagulation management. METHODS: This was a researcher-initiated, international, double-center, mixed qualitative-quantitative study that included the anesthesiologists and intensive care physicians who participated in the previous Visual Clot study. After the participants solved six coagulation scenarios using Visual Clot, we questioned them about the perceived pros and cons of this new tool. Employing qualitative research methods, we identified recurring answer patterns, and derived major topics and subthemes through inductive coding. Based on them, we defined six statements. The study participants later rated their agreement to these statements on five-point Likert scales in an online survey, which represented the quantitative part of this study. RESULTS: A total of 60 physicians participated in the primary Visual Clot study. Among these, 36 gave an interview and 42 completed the online survey. In total, eight different major topics were derived from the interview field note responses. The three most common topics were "positive design features" (29/36, 81%), "facilitates decision making" (17/36, 47%), and "quantification not made" (17/36, 47%). In the online survey, 93% (39/42) agreed to the statement that Visual Clot is intuitive and easy to learn. Moreover, 90% (38/42) of the participants agreed that they would like the standard result and Visual Clot displayed on the screen side by side. Furthermore, 86% (36/42) indicated that Visual Clot allows them to deal with complex coagulation situations more quickly. CONCLUSIONS: A group of anesthesia and intensive care physicians from two university hospitals in central Europe considered Visual Clot technology to be intuitive, easy to learn, and useful for decision making in situations of active bleeding. From the responses of these possible future users, Visual Clot appears to constitute an efficient and well-accepted way to streamline the decision-making process in viscoelastic test-based coagulation management.

Validation of the Raw National Aeronautics and Space Administration Task Load Index (NASA-TLX) Questionnaire to Assess Perceived Workload in Patient Monitoring Tasks: Pooled Analysis Study Using Mixed Models.

BACKGROUND: Patient monitoring is indispensable in any operating room to follow the patient's current health state based on measured physiological parameters. Reducing workload helps to free cognitive resources and thus influences human performance, which ultimately improves the quality of care. Among the many methods available to assess perceived workload, the National Aeronautics and Space Administration Task Load Index (NASA-TLX) provides the most widely accepted tool. However, only few studies have investigated the validity of the NASA-TLX in the health care sector. OBJECTIVE: This study aimed to validate a modified version of the raw NASA-TLX in patient monitoring tasks by investigating its correspondence with expected lower and higher workload situations and its robustness against nonworkload-related covariates. This defines criterion validity. METHODS: In this pooled analysis, we evaluated raw NASA-TLX scores collected after performing patient monitoring tasks in four different investigator-initiated, computer-based, prospective, multicenter studies. All of them were conducted in three hospitals with a high standard of care in central Europe. In these already published studies, we compared conventional patient monitoring with two newly developed situation awareness-oriented monitoring technologies called Visual Patient and Visual Clot. The participants were resident and staff anesthesia and intensive care physicians, and nurse anesthetists with completed specialization qualification. We analyzed the raw NASA-TLX scores by fitting mixed linear regression models and univariate models with different covariates. RESULTS: We assessed a total of 1160 raw NASA-TLX questionnaires after performing specific patient monitoring tasks. Good test performance and higher self-rated diagnostic confidence correlated significantly with lower raw NASA-TLX scores and the subscores (all P<.001). Staff physicians rated significantly lower workload scores than residents (P=.001), whereas nurse anesthetists did not show any difference in the same comparison (P=.83). Standardized distraction resulted in higher rated total raw NASA-TLX scores (P<.001) and subscores. There was no gender difference regarding perceived workload (P=.26). The new visualization technologies Visual Patient and Visual Clot resulted in significantly lower total raw NASA-TLX scores and all subscores, including high self-rated performance, when compared with conventional monitoring (all P<.001). CONCLUSIONS: This study validated a modified raw NASA-TLX questionnaire for patient monitoring tasks. The scores obtained correctly represented the assumed influences of the examined covariates on the perceived workload. We reported high criterion validity. The NASA-TLX questionnaire appears to be a reliable tool for measuring subjective workload. Further research should focus on its applicability in a clinical setting.